arXiv: 1503.02927v 1 [cs.IT] 10 Mar 2015 


l 


Broadcasting Correlated Vector Gaussians 

Lin Song, Jun Chen, and Chao Tian 


Abstract —The problem of sending two correlated vector Gaus¬ 
sian sources over a bandwidth-matched two-user scalar Gaussian 
broadcast channel is studied in this work, where each receiver 
wishes to reconstruct its target source under a covariance distor¬ 
tion constraint. We derive a lower bound on the optimal tradeoff 
between the transmit power and the achievable reconstruction 
distortion pair. Our derivation is based on a new bounding 
technique which involves the introduction of appropriate remote 
sources. Furthermore, it is shown that this lower bound is 
achievable by a class of hybrid schemes for the special case where 
the weak receiver wishes to reconstruct a scalar source under the 
mean squared error distortion constraint. 
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I. Introduction 

Unlike in point-to-point communication systems where the 
source-channel separation architecture is optimal m, in multi¬ 
user systems, a separation-based architecture is usually sub- 
optimal. In such scenarios, hybrid schemes have emerged as 
a promising approach to gain performance improvement over 
either pure digital schemes (separation-based schemes) or pure 
analog schemes, e.g., in (2j for bandwidth-mismatch Gaussian 
source broadcast (see also 0-El for variants of this problem), 
and in j6j| for sending a bivariate Gaussian source over a 
Gaussian multiple access channel. Recently, building upon the 
important work by Bross et al. 0 as well as {§) and 0, Tian 
et al. cna showed that, for the problem of broadcasting a 
bivariate Gaussian source, hybrid schemes are not only able 
to provide such performance improvement, they can in fact be 
optimal. 

In this paper, we consider the problem of sending two corre¬ 
lated vector Gaussian sources over a bandwidth-matched two- 
user scalar Gaussian broadcast channel, where each receiver 
wishes to reconstruct its target source under a covariance 
distortion constraint (see Fig. 0. This can be viewed as a 
vector generalization of the problem studied in Q, ®, m. 
We derive a lower bound on the optimal tradeoff between 
the transmit power and the achievable reconstruction distortion 
pair. Furthermore, it is shown that this lower bound is tight for 
the scenario, referred to as the vector-scalar case, where the 
weak receiver wishes to reconstruct a scalar source under the 
mean squared error distortion constraint. It is worth noting 
that the brute-force proof method in 0, Col is difficult to 
generalize to the problem being considered. Therefore, instead 
of seeking explicit upper and lower bounds and showing their 
tightness by direct comparison, we take a more conceptual 
approach in the present work. In particular, the derivation 
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Fig. 1. Broadcasting correlated vector Gaussian sources. 


of our lower bound is based on a new bounding technique 
which involves the introduction of appropriate remote sources; 
moreover, to obtain a matching upper bound in the vector- 
scalar case, we construct a scheme with its parameters spec¬ 
ified according to an optimization problem motivated by the 
lower bound. Another finding is that the optimal scheme is in 
general not unique. Indeed, we show that, in the vector-scalar 
case, the optimal tradeoff between the transmit power and the 
reconstruction distortion pair is achievable by a class of hybrid 
schemes, which includes the scheme proposed by Tian et al. 
Go) as an extremal example. 


II. Problem Definition 


Let Sj be an m, x 1 zero-mean random vector, i = 1,2. We 
assume that Si and S 2 are jointly Gaussian with covariance 
matrix 


J Si,S 2 = 


s Sl 

E[S 2 Sf] 


nSiS%] 

Ss 2 


where Ss ; = E[S,Sf], i = 1,2. Let the broadcast chan¬ 
nel additive noises Z\ and Z> be two zero-mean Gaussian 
random variables, jointly independent of (Si, S 2 ), with vari¬ 
ances iV| and N 2 , respectively; it is assumed that N 2 > 
Ni. Let {(Si(f), S 2 (f), Zi(t), Z 2 (t))} c j*L 1 be i.i.d. copies of 

(S 1; s 2 , Z 1 ,z 2 ). 

Definition 1: An (n, P, Di,D 2 ) source-channel broadcast 
code consists of an encoding function / : R miX " x R m2X ” — > 
R” and two decoding function g i: : R ra —> R miX ", i = 1,2, 
such that 


-E\X n (X n ) T ] < P, 
n 

3e[(S? - S”)(S" - S”) T ] d D,, * = 1,2, 


where X n = /(S”,S£) and S” = gfiYfi), i = 1,2, with 
Yfi =X n + Z f, * = 1,2. 
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It is clear that the performance of any source-channel broad¬ 
cast code depends on (Z[ l , Zf) only through their marginal 
distributions. Therefore, we shall assume the broadcast channel 
is physically degraded and write Z% = Z" + Z", where Z n 
is a zero-mean Gaussian random vector with i.i.d. entries of 
variance N 2 — N\ and is independent of Z'f It is also clear 
M App. 3.A] that there is no loss of optimality in assuming 

s? = fl<(^ n )=E[s?|y7*],i = i,2. 

Definition 2: We say (P, Di,D 2 ) is achievable if there 
exists an (n, p,d 1 ,d 2 ) source-channel broadcast code. Let 
V'D denote the closure of the set of all achievable (P, Di, D 2 ). 

Definition 3: Let P(Di,D 2 ) = inf{P : (P, Di,D 2 ) £ 

VV}. 

With the above definitions, it is clear that the fundamen¬ 
tal problem in this joint source-channel coding scenario is 
to determine the function P(Di,D 2 ), which characterizes 
the optimal tradeoff between the transmit power and the 
achievable reconstruction distortion paifl Unless specified 
otherwise, we assume Ss ll s 2 0 and >- 0, i = 1, 2. 

The remainder of this paper is organized as follows. We 
derive a lower bound on P(Di, D 2 ) in Section|III] It is shown 
in Section |IV] that, for the vector-scalar case, this lower bound 
is achievable by a class of hybrid schemes. We conclude 
the paper in Section [V] Throughout this paper, the logarithm 
function is to base e. 


Eu 2 ■ Therefore, one can simply take the supremum in {T} over 
Eu 2 >- 0. 

Remark: Theorem Q] is in fact closely related to fl2j Th. 1], 
A detailed explanation of the connections between these two 
results can be found in 031 . 

The following two elementary inequalities are needed for 
the proof of Theorem [T] For completeness, their proofs are 
given in Appendices [A] and [B] 

Lemma 1: For any m x n random matrices W and W, 


L(W|W) < - log 


27re 


E[(W — W)(W — W) 5 


Lemma 2: Let Wj be an mi x n zero-mean random matrix, 
i = 1,2. If ±E[(Wf, W^) T (Wf, W^)] >- 0, then 


71 

/l(W!|W 2 ) < - log 


^E[(Wf,W^) T (Wf,W^)] 

|2^E[W 2 W^]| 


Now we proceed to prove Theorem |T| 

Proof of Theorem [7} For any (n,P, Di,D 2 ) source- 
channel broadcast code, let S” = gi{f r fi) = E[S”|L^ n ], 
i = 1,2, and S 2 = E[S 2 |Yi"]; furthermore, let 


III. Lower Bound 


Let U, be an m, x 1 zero-mean random vector, i = 1,2. We 
assume that Ui and U 2 are jointly Gaussian with covariance 
matrix 


Su!,u 2 


Su, E[U!U^] \ 

E[U 2 U^] Su 2 ) 



with ©! = ie[(s? - S5*)(S? - S?) T ], 0 2 = ^e[(s 2 - 
S^)(S^ - S^) T ], and T = lE[(S? - S?)(S£ - S^) T ], Note 
that © satisfies ([2} and ([3]). Therefore, it suffices to show that 


where Eu, = E[UiUf], i = 1,2. 

The main result of this section is the following theorem. 
Theorem 1: 


P(D l5 D 2 ) > inf sup N\ 
® Eu 1 ,u 2 >'0 

+ (1V 2 -1Vi)J 


l©2 


j u 2 | 


|©||D 2 + S U2 

Ss 2 + S U: 1 


|D 2 + E 


u 2 | 


- N 2 (1) 


with the inhmum taken over (mi + m 2 ) x (m 1 + m 2 ) matrix 
© subject to the constraints 


0 ^ © A E Sl ,s 2! (2) 

©1 A Dr. (3) 


Here we assume that © is partitioned to the form 


© = 


©1 # \ 

# ©2 )' 


where ©; is of size mi x rrii for * = 1,2. 

Remark: It is interesting to note that the objective function 
on the right-hand side of ([]} depends on Eu 1 ,u 2 only through 


’This formulation is slightly different from that in 0, GE where the 
power P is fixed, and the tradeoff between the reconstruction distortion pair 
is considered. We find the current formulation more suitable here, since both 
receivers are to reconstruct vector sources. 


P > Ni 


|Ss 1 .s a ||©2 + E 


U 2 


0||D 2 + E U2 | 

'Ss 2 + Eu 2 


+ (V 2 - iVi) 


|D 2 + Su 2 | 


-No 


(4) 


for all Eu!,u 2 0. 

Let {Ui(f),U 2 (f)}^ =1 be i.i.d. copies of (Ui,U 2 ). We 
assume that (U”,U 2 ) is independent of (Sj 1 , S 2 , Z”, Z n ). 
Define V" = S" + U", * = 1,2. Here Vi and V 2 can be 
understood as the remote sources that should be reconstructed, 
yet the encoder only has access to Si and S 2 . The introduction 
of (Vi, V 2 ) is partly inspired by Ozarow’s converse argument 
for the Gaussian multiple description problem mi (see also 

El-El). 

We shall first bound /(V 2 ; Yf ). In view of the fact that 
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0 < F(V 2 ; Yf 1 ) < I(X n ; Yf ) < - log 


p + n 2 
n 2 


we have 


/(VJ;1T) 



p + n 2 

aP + N 2 


(5) 











for some a G [0,1]. On the other hand, 

I (V£; Y £) 

= h(V”) - h(V?\Y 2 n ) 

TL 

= - log |27re(Ss 2 + Su 2 )| - h(y%\Y?) 

f Y~l A 

>-log|2^e(E S2 +Eu 2 )|-h(V£|S£) 

Tl 

> 2 lo § l Ss 2 + Su 2 | 


n i 

^2 l0g 


-E[(VJ - S£)(V" - S") T ] 


> 2 l0 & I SS = + SlJ 2l 


71 1 

- 2 l«g 


-e[(s;-s;ks;-s ;) 5 


J U 2 


n |£s 2 +S U2 | 
- 2 8 |D 2 + S U2 | 


|Ss 2 + S Ua | < P + N 2 


Ml?|V?) < -^^(aP + JVi)). 


Note that 


/(v^y^iv^) 

= ft(l?|Va) - M 1 ?|V?,^) 

77 

< -log(2^e(aP + iV 1 ))-/ i (y i "|V",V") 

= f log - ^ 0 ?|v?,vj) + M1?|S?, SJ) 

77 ry_P -I- Ni 

= 2 ^ - /(S?, S"; 1?|V5>, V”) 

_ n aP + ATi _ n |27reS Sl ,s 2 ||27reS Ul]U2 | 
2 ^ Ni 2 8 |27re(Ss 1 ,s 2 + ^Ui,u 2 )l 

+ Ms?,sj|v?,^ ) i?) 

_ n aP + ATi _ n |27reE S i,s 2 l|27reE Ul!U2 | 
2 8 iVi 2 8 |27re(Ss 1 ,s 2 + Su!,u 2 )| 

+ /i(S? - SJ,S£ - S£|V" - SJ, VJ - s^y^) 

< n aP + Ni n |27reS Sl ,s 2 1 |27reS UliU2 1 

— 2 8 N\ 2 8 |27re(Ss 1 ,s 2 + Sui,u 2 )| 

+ h {SJ - SJ, S£ - S£|V" - SJ, V” - SJ) 

aP + JVi n |£si,s 2 || s U!,u 2 1 

- 2 ° 8 N x 2 ° g |S Sl>S 2 +S UljU2 | 


n leHSu^uJ 

2 S |0 + S UllU2 | 

_ n , (aP + Mi)|Ssi,s 2 + Su 1 .u 2 ||0| 

2 8 7 Vi|S Sl ,s 2 ||© + S Ul: u 2 | 

where (ITOt is due to Lemma [2] On the other hand, 

J(V?;3?|V2) 

= WTO-Mvrivj.i?) 


( 10 ) 


( 11 ) 


n . 


( 6 ) 


= 2 log 


|27re(S Sl ,s 2 + Su!,u 2 ) 
|27re(Ss 2 + Su 2 )| 


-Mvnvj.i?) 


(7) 


_ n |27re(S Sl ,s 2 + Sup.uJI 
“ 2 ° S |27re(E S2 +£u 2 )| 
-MV?-S?|V5-SJ,1?) 
> «i . |27re(S Sl ,s 2 + Sui,u 2 " 
- 2 ° S |27re(E S2 +Su 2 )| 


-Mvr-s?|vj-s5) 


J Ui,U 2 J 


where © follows from LemmaQ] Combining (0 and 0 gives 

( 8 ) 


|D 2 + X)u 2 I a P + -^2 

Now we proceed to bound J(V";y 1 n \V%). Since h(Y . 2 n ) < 
j log(27re(P + iV 2 )), it follows from 0 that 

77 

h(V 2 n |V£) < - log(27re(aP + N 2 )). (9) 

By the entropy power inequality, 

h(Y? |VJ) > ^ log + e Z h{zn) ^ 

= ^ log ^e^ /t l Yl "l v 2 1 + 2ne(N 2 - , 

which, together with 0 , implies 


> n | 2 ^e(S Sl ,s 2 _ 

-2 8 |27re(E S2 +Su 2 )| 

_ n \2ne(& + gupjjJ} 

2 ° g |27re(© 2 + Su 2 )| 

_ n , . |Ssi,s 2 + £ui,u 2 ||®2 + Su 2 | 
2 ^ |Sg 2 + Su 2 ||© + Sui.U 2 | 


( 12 ) 


(13) 


where (fl2l > follows from Lemma [2] Combining (fTTTi and (11 31 ) 
yields 

|0 2 + S U2 | (aP + JV!)!©! 


|Ss 2 +Su 2 | JVi|S Sl ,s 2 l 

One can readily obtain 0 from 0 and (IT4l) by eliminating 
a. This completes the proof of Theorem Q] ■ 

This theorem leads us to the following (potentially weak¬ 
ened) lower bound on P(Di, D 2 ). Somewhat surprisingly, this 
lower bound turns out to be tight in the vector-scalar case. 
Corollary 1: 

P(D„D 2 )> sup I 

Sup.u^O |L»l + + ^U 2 | 

+ (N 2 - ^ + ^ U2 , 1 - n 2 . 


|D 2 + £u 2 | 


Proof of Corollary [7} Note that 
|s Sl ,s 2 ||©2 + Su 2 | 


| 0 ||d 2 + Su 2 1 

_ I^Sp.Ss 11©2 + Su 2 ||0 + Su^Ua | 

101 |D 2 + Xu 2 ||0 + Sui,u 2 | 
For any 0 satisfying 0 and 0, we have 


10 + Sup, 


u 2 


|©| 

! ©2 + £u 2 | 


> 


> 


|Ss!,S 2 + Sup.Ual 


J Sp,S 2 


> 


Di + EuJ’ 


(15) 


06) 


(17) 


I© + Sui jU2 | 101 + Supl 

where (fl6t is due to the fact that for A 2 P 

Ai >- 0 and B L 0, and the hrst inequality in (fl7l) is a 
consequence of Fischer’s inequality. Substituting (IT6l) and (fTTIl 
into 00 yields 


|Ss 1 ,s 2 ||©2 + S U2 | 
|©||D 2 + Su 2 


> 


S Sl ,s 2 + S Ul; u 2 [ 

D x + Eu, ||D 2 + Su 2 | ’ 
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from which Corollary Q] follows immediately. ■ 

It is also possible to derive this lower bound by taking a 
shortcut in the proof of Theorem Q] 

Alternative Proof of Corollary [7f Note that 


= h(Y?\V™)-h(Y? |V?,V£) 
n 

< - log(2 ne(aP + N{)) - h{Y?\S?, SJ) (18) 


= -log(27re(aP + iV 1 ))-/ l (Z 1 ”) 

n , aP + Ni 
= 2 l0g ——■ 


On the other hand. 


(19) 


r(Vi";lT|V£) 

= MV?|V5)-/ l (v?|V5 ) i7‘) 
|27re(S Sl ,s 2 + Sui,u 2 )| 

2 g |27re(Ss 2 + S Ua )| 

> « , , |27re(S Sl ,s 2 + Sll.uJI 
- 2 ° S |27re(£ S2 + S] U2 )| 

> n |27re(Ss 1 ,s 2 + S Ul ,u 2 )| 
“2 g |27re(Ss 2 + Su 2 )| 

> n |27re(S Sl ,s 2 + s Ui,u 2 )l 

-2 g |27re(S S2 + S U2 )| 


77 

- - log |27re(©i + EuJI 

> 'll lotr l s Si,s 2 + Sui,u 2 | 

-2 g |Ss 2 +S U2 ||D 1 + S Ul |’ 


Mvriv?,yr) 

h(V? in”) ( 20 ) 

/»(vns?) 

( 21 ) 

( 22 ) 


where (fTil) follows from Lemma D] Combining (fl9l> and d22l> 
yields 


|£si,s 2 + Su!,u 2 1 ^aP + Ni 
|Ss 2 + S U2 ||D 1 +S Ul - N\ ’ 

which, together with ([Sj, proves Corollary [I] ■ 

In order for the inequalities in (ITSl) and (l20l > to become 
equalities, we need to have 


/(V^V^IT 1 ) = J(S?,S2;17), (23) 

/(V^VJiy”) = 0. (24) 


It will be seen that these two conditions provide important 
guidelines for constructing hybrid schemes that achieve the 
lower bound in Corollary Q] Note that the derivation of this 
lower bound is based on a consideration of the scenario where 
V 2 is provided to the strong receiver by a genie. Intuitively, a 
necessary condition for this lower bound to be tight is that the 
side information provided by the genie is superfluous, which 
is exactly the implication of d24l >. 


IV. the Vector-Scalar Case 

We shall show in this section that the lower bound in Corol- 
lary |T]is tight for the vector-scalar case, i.e., the scenario where 
the weak receiver wishes to reconstruct a scalar source (i.e., 
W 2 = 1) under the mean squared error distortion constraint. 
In this special setup, we denote S 2 , Ss 2 , D 2 , U 2 , Su 2 by 
S 2 , cr| 2 , d 2 , U 2 , <?u 2 , respectively. 


Theorem 2: 


P(Di,d 2 ) 


sup N\ 


|Ssi,S2 ^Ui,t / 2 I 

IDi + SuJ^ + a^) 


+ (^2 


JVi)- 


's 2 


't/a 


’U 2 


N 2 . (25) 


A. Upper Bound 

Proof of Theorem [2} To the end of proving Theorem [2] 
it suffices to show that the right-hand side of (l25l > is (asymp¬ 
totically) achievable and consequently is an upper bound on 
P(Di,d 2 ). Our achievability argument is based on a hybrid 
scheme, which bears some resemblance to the one proposed 
by Puri et al. in a different setting m (see also DU), it 
will be seen that this hybrid scheme is semi-universal in the 
sense that the encoder only needs to know Ni but not iV 2 . 
Let us first introduce a zero-mean random vector Si ( 7 ) and 
a zero-mean random variable ,S ' 2 ( 7 ) that are jointly Gaussian. 
They are related with (Si, S 2 ) via a backward Gaussian test 
channel (Si, S 2 ) = (Si (7)+Qi, S 2 {'y)+Q 2 ). where (Qi,Q 2 ) 
is independent of (Si( 7 ), S^t)). The covariance matrix of 
( 81 ( 7 ), £> 2 ( 7 )), parametrized by a scalar variable 7 , is to 
be specified later. We assume that (Si, S 2 , 81 ( 7 ), S 2 {'y)) is 
independent of (Z 1, Zf). Note that we can write 

51 (7) =E[Si( 7 )|S 1 > S , 2,&( 7 )] +Wi 

= AiS 1 +a 2 ^2 + a 3 5 2 ( 7 )+W 1 , 

5 2 (7) =E[S 2 (7)|Si,5 2 ] + IL2 

= Si T b 2 S 2 — W2, 

where Wi is independent of (Si, 1 S 2 , $ 2 ( 7 )), anc l ^2 is 
independent of (Si,^)- Next define 

Si (7) = AiSi + a a 52 + Wi. 

We are now in a position to describe the scheme (See Fig. 
0 . Since the scheme is a combination of some well-known 
coding techniques, e.g., Wyner-Ziv codes |20) and dirty paper 
codes EQ, we only provide an outline of the encoding and 
decoding steps, and then focus on the condition that guarantees 
correct decoding. 

Encoding: Let the channel input X n , with average power 
P( 7 ), be a superposition of an analog signal Xf and a digital 
signal X'l (i.e., X n = X™ + X’j). The analog portion is 
given by Xf = /3(bfS" + 62 ^ 2 ) for some non-negative 
number /3 to be specified later. For the digital portion XJf the 
encoder first uses a Wyner-Ziv code of rate R with codewords 
generated according to Si( 7 ), with (S™, 5^) as the input, and 
with Yf = Xf + Xf + Zj 1 as the decoder side information; 
the encoder then determines the digital portion of the channel 
input Xf to send the bin index of the chosen Wyner-Ziv 
codeword S" ( 7 ) by using a dirty paper code of rate R with 
Xf treated as the channel state information known at the 
encoder. We define P a = E[(A' a ) 2 ] and Pd = E[(Ad) 2 ], where 
X a = /3(b^Si + b 2 S 2 ) and Xf are mutually independently 
zero-mean Gaussian random variables, and P a + Pd = /'(yj. 
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K- 


y n 

J 2 


DP Decodindg 


WZ Decoding 


s;w 


LMMSE 



s;M 


LMMSE 


k(r) 


Fig. 2. An illustration of the hybrid scheme in Section EWaI 


Decoding: Receiver 1 first decodes the dirty paper code; it 
then further recovers £>"(7) by decoding the Wyner-Ziv code 
with Y™ as the side information. In view of the fact that the 
linear MMSE estimate of Si based on £>1(7) and Y\ = X a + 
X d + Zi is Si (7) = Si (7) + / 3 _1 a 3 y 1 , Receiver 1 can use 
S"( 7 ) = S"( 7 )+/ 3 _ 1 a 3 F 1 TI as the reconstruction of S”. Since 
the linear MMSE estimate of S 2 based on Y 2 = X a + X d + Z 2 
is 52(7) = pY 2 with p = E[S 2 X a ](P( 7 ) + N 2 )~ l , Receiver 
2 can simply use S 2 ( 7 ) — pYp as the reconstruction of S 2 , 
where Y.J 1 = X^+X^+Z^', the resulting distortion is denoted 
by d 2 (j). 


ensured to be decoded correctly by d28l >. and thus we fo¬ 
cus on the decodability of dirty paper code. First note that 
(l27l >. together with the fact that I(X a \Yi) = J(Si, S2', Yi), 
implies that I (Si, S 2 ',Yi) = I(Si, S 2 ', ^( 7 )); moreover, 
since both X d + Z\ and W 2 , which are Gaussian random 
variables, are independent of (S 1 , 82 ), it follows that the 
joint distributions of (S 1; S 2 , / 3 ~ 1 Yi) and (S 3 , S 2 , ^2(7)) are 
identical, which, in view of the fact that Wj is independent 
of (Si, S2, 62 ( 7 ), Yi), further implies that the joint distribu¬ 
tions of (Si,52,Si( 7 ),/3 _1 yi) and (Si, S 2 , Si(7), ^2(7)) are 
identical^. Therefore, we have 


Coding Parameters: For a given covariance matrix of 
(Si( 7 ), 62 ( 7 )), three parameters /3, P d , and R still need to 
be specified for the aforedescribed scheme. Equivalently, we 
shall specify / 3 , P( 7 ), and R, since /3 determines P a and 
P d = P( 7 ) — P a . Let us first choose P( 7 ) such that 

1 p(n/) + _/Vl 

I(Si,S 2 ', Si( 7 ), <S , 2 ( 7 )) = 2 log — ( 26 > 

The parameter /3 is then chosen such that 

I(X a ;Yi) = I(Si,S 2 -,S 2 ('Y)), (27) 


which is always possible because 


I(Si,S 2 ; S 2 h)) < I(Si,S 2 \ Si( 7 ), 5 2 ( 7 )) 
1 , P( 7 ) + Ni 

= 2 ° S ~Ni ’ 


and one can let I(X a ; Yj) take any value in [0, \ log P ^ 7 J ^~ iVl ] 
by varying /3. Finally set 


R = I(S 1 ,S 2 ;Si('y)\Y 1 ). (28) 


Now the scheme is fully specified for any given covariance 
matrix of (Si( 7 ), S 2 (j)). 


R = I( Si, 5 2 ;Si( 7 )| 5 2 ( 7 )). 

Furthermore, note that 

/(Si,5 2 ;Si(7)|5 2 ( 7 )) 

= /(Si, 5 2 ; Si(7), S 2 ( 7 )) - I(Si,S 2] S 2 (y)) 
= I(S 1 ,S 2 ;S 1 ( 7 ),S 2 ( 7 ))-I(X a ;Y 1 ) 


(29) 


= ilo g L2i± 
2 S iVi 


Nl 1 lor P(7) + Nl 

2 S Pd + Ni 


1 . Pd + Ni 
= 2 l0 ^ ~Ni ’ 

which, together with ( f29t , ensures that Receiver 1 can correctly 
decode the dirty paper code. 


Optimizing the Covariance Matrix of ( 81 ( 7 ), 5 2 ( 7 )): Now 
only the covariance matrix of (Si( 7 ), S 2 ( 7 )) remains to be 
specified. To this end we formulate the following maximiza¬ 
tion problem. It will become clear that this maximization 
problem is motivated by the lower bound in Corollary Q] In 
particular, it will be seen that the hybrid scheme and the remote 
sources induced by the optimal solution (and the associated 
Lagrangian multipliers) of this maximization problem possess 
the desired properties (see ( f23l) and (l24ll ). 


Conditions for Correct Decoding: The Wyner-Ziv code 
and the dirty paper code need to be decoded correctly at 
Receiver 1. It is easily seen that the Wyner-Ziv code is 


2 We have implicitly assumed that E[ (bj S 1 -h ) 2 ] > 0 (which implies 
that the P a and the f3 determined by (21 \ are positive). For the degenerate 
case b^Si -\-b 2 S 2 = 0 (which is possible if and only if S 2 ( 7 ) = 0 ), one 
can simply set X a = 0 and /3~ 1 Yi = 0 . 
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Given 7 £ (0, 00 ), let ©( 7 ) denote the solution^ to 

maxlog|©| (30) 

subject to ©i A Di, 

O2 < 7 , 

0 r< © ^ S Sl ,.? 2 , 


where ©1 is the first mi x m\ diagonal submatrix of ©, 
and 0 2 is the (mi + l,mi + 1) entry of ©. It can be shown 
(see Appendix D that ©( 7 ) is a continuous function of 7 . 
We denote the first x m\ diagonal submatrix of @( 7 ) by 
©!( 7 ), and the (mi + l,m± + 1 ) entry of ©( 7 ) by $ 2 ( 7 )- 
Now choose the covariance matrix of (Si ( 7 ), £ 2 ( 7 )) to be 
Ssi,s 2 — ©( 7 ); as a consequence, the covariance matrix of 
Si( 7 ) is Ss! — © 1 ( 7 ), and the variance of 82 ( 7 ) is cr | 2 — 
$2 ( 7 )- Accordingly, (l26t reduces to 



|Ssi,s 3 | 

I © ( 7 ) I 



P( 7 ) + iVt 

Ni 


(31) 


Evaluating the Distortions and the Transmit Power: For 

the distortion at Receiver 1, it is readily seen that 

E[(S 1 -S 1 ( 7 ))(S 1 -S 1 ( 7 )) t ] 

= E[(S 1 -S 1 ( 7 ))(S 1 ~S 1 ( 7 )) t ] (32) 

= ©i(7) 

8 T>i, 

where (l32l > is true because the joint distributions of (Si, Si ( 7 )) 
and (Si, Si( 7 )) are identical (which is further due to the 
fact that the joint distributions of (Si, Si( 7 ),/ 3 - 1 Yl) and 
(Si, Si( 7 ), <S < 2 ( 7 )) are identical). It is worth noting that the 
linear MMSE estimate of (Si, £ 2 ) based on (£> 1 ( 7 ), Yi) 
is (Si( 7 ),/3 - 1 Yi). In view of this fact. Receiver 1 can 
use (S"( 7 ),/3 _ 1 Y") as the reconstruction of (Si,£ 2 ). 
Since the joint distributions of (Si, £ 2 , Si( 7 ), /3 - 1 Yi) and 
(Si, £ 2 , 81 ( 7 ), £ 2 ( 7 )) are identical, we have 

E[(Sf-Sf(7 ),£ 2 t -r'Y?) 7, 

(Sf-Sf( 7 ),£ 2 r -/3- 1 Y 1 T )] 

= E[(Sf-Sf( 7 ),£ 2 T -£ 2 T ( 7 )) T 
(S^Sf( 7 ),£ 2 T -£ 2 T ( 7 ))] 

= ©( 7 )- (33) 

Therefore, 7 can be interpreted as an auxiliary constraint on 
the reconstruction distortion for £ 2 at Receiver 1, and ©( 7 ) 
is the actual covariance distortion achieved at Receiver 1 for 
reconstructing (Si,£ 2 ). 

'Note that ©( 7 ) must be positive definite. Since log | • | is strictly concave 
over the domain of positive definite matrices, it follows that © ( 7 ) is uniquely 
defined. 


Note that P( 7 ) is a continuous function of ©( 7 ) (which is 
implied by (Oil ) and consequently is a continuous function of 
7 for 7 £ (0, 00 ). Moreover, it can be verified that 


1 erf. 

_ log -22- 

2 °° 1 ( 2 ( 7 ) 

= /(£ 2 ; Y 2 ) 

= 1 P( 7 ) + N 2 

2 8 E[(Y 2 - E[Y 2 |£ 2 ]) 2 ] 

1. P{l) + N 2 

2 ° S E[(Y 1 -E[Yi|£ 2 ]) 2 ]+iV 2 -iVi 


1 


1 


= o l0 g( p (7) + N 2 )-~ log — 


1 


a 2h(Y\ | ^? 2 ) 


27re 


+ N 2 - iVi 


= 2 l0 §( p ( 7 ) + N 2 ) 


- 2 l0g I “ e 

= \ log(P( 7 ) + N 2 ) 


( J_ e 2(fc(n)-7(S a ;Yi)) + AT, _ Nl \ 

\ 2 ne ) 


~~ 2 l0g 


P( 7 ) + Wi 2 ft.(g 2 |y 1 ~) 


27recr| 2 


+ N 2 - Nx 


= - log(P( 7 ) + N 2 ) 


~~ 2 l0g 


(P( 7 ) + Wi) 0 2 ( 7 ) 


+ N 2 - JVi 


's 2 


(34) 


where OH is due to the fact that h(S 2 \Yi) = A log(27re0 2 (7)) 
(which is implied by P3|>). Hence, 


d 2 (n) = 


(P(7) + ^1)02(7) + ( N 2 - Ni )cr | 2 


P( 7 ) + n 2 

Note that both P( 7 ) and 0 2 (7) are continuous in 7 ; further¬ 
more, P( 7 ) and 02 ( 7 ) tend to infinity and zero, respectively, 
as 7 —> 0. Therefore, d 2 ( 7 ) is a continuous function of 7 for 
7 £ ( 0 , 00 ), and d 2 ( 7 ) tends to zero as 7 —» 0 . 

We shall show that 

I^Si.Sa + EuijUal 

^tfFT 

-‘u 1 ,u 2 yo 


P( 7 ) < sup iVi-—-—— ,, , , , - 

Su,.[;,so |Di + Sui | (d 2 ( 7 ) + cr^) 


+ (N 2 - N{) 


2 


’U 2 


02 ( 7 ) 


- N 2 (35) 


’u 2 


for 7 £ (0,oo). To this end we revisit the maximization 
problem in ( l30l . Note that ©( 7 ) must satisfy the following 
KKT conditions 


0- 1 (7)-A-M = O, (36) 

Ai(Di - ©1(7)) = 0 , 

A 2 (7 - 02 ( 7 )) = 0, 

M(£ Sl ,s 2 - 0 ( 7 )) = 0 , ( 37 ) 

where M A 0, A x A 0, X 2 > 0, and A = diag(A!,A 2 ). 
Let HiTEiSf be the eigenvalue decomposition of Ai, where 
Hi is a unitary matrix, and III = diag(7Ti, • • • ,7Tr,0, ,0) 

with 7 Ti > 0, i = 1, ,r. Define H = diag(Hi,l) and 

II = diag(IIi, A 2 ). Let II( be a positive semidefinite diagonal 
matrix obtained by subtracting e from each positive diagonal 
entry of II, where e is an arbitrary positive number smaller 












7 


than the minimum non-zero diagonal entry of II. Since 0 >~ 
0, it follows that 3 7 0 _ 1 ( 7 )S is positive definite. Moreover, 
in view of ( l36l ). we have S T © _ 1 ( 7)3 — II = E r M3 >7 0. 
Therefore, 3 7 0 1 ( 7)3 — II' is positive definite when e is 
sufficiently small. For any e with 3 7 0 _ 1 ( 7)3 — II' >~ 0, 
we choose a positive number e', which is a function of e and 
tends to zero as e —> 0 , such that 

H T 0 - 1 ( 7 )H-n e >- 0 , 

where II e is a positive definite diagonal matrix obtained by 
adding e' to each zero diagonal entry of II'. Now let A e = 
Sn £ S' J and lui e ,Uz e = A 7 1 — ©( 7 ). Note that 

s t ©~ 1 ( 7 )h — n e >- 0 
=> 0 _1 ( 7 ) >- A e 
=* K 1 >- ®(7)- 


Therefore, Eu x 6 is positive definite when e is sufficiently 
small. 

Let Ui, e and U 2>e be jointly Gaussian with mean zero 
and covariance matrix Eui e ,i 7 2 6 , where Ui e is an toi x 1 
Gaussian random vector with covariance matrix Eu, e (which 
is the first toi xmi diagonal submatrix of Eu, c ,u 2 6 ) and U 2tli 
is a Gaussian random variable with variance a^ 2 (which is 
the (to 1 + 1 , 777,1 + 1 ) entry of Eu le ,tt 2l )- We assume that 
(Ui, e ,( 72 ,e) is independent of (Si, £ 2 , Si( 7 ), £ 2 ( 7 ), Zx, Z 2 ). 

Note that 


|S Sl ,s 2 + Eu 1i6) (7 2 ,.| 

Iim —— . -—-r- 

|0(7) + E Ul; , iC/2e | 

= 1 j m ls.. A + A .-;-e(7)l 

t->° | A c 7 | 

= lint |AcE Sl ,s 2 + I - A e 0 ( 7 )| 

£—>0 

= |A53 Sli s a +I-A0( 7 )| 

= | 0 - 1 ( 7 )E Sl , 5 2 - ME Sl) s 2 + M©( 7 )| 
= |S s ,s 2 

" |0(7)l 

_ P( 7 ) + N, 

Ni ’ 


(38) 

(39) 

(40) 


where ( l38l > and ( [39b are due to < [36b and ( f37l >. respectively. 
Moreover, by the definition of Eu, u 2 ,> we have 


©(7) + Su lie ,t7 2 , e 

= diag(©i(7) + E Ule , 6*2(7) + 0tf 2> J. (41) 


It is clear that 


I{s 2 + U 2 ,e,Y 2 ) = h(Y 2 ) - h{Y 2 \S 2 + U 2 , e ) 

1 , . p(i) + n 2 
2 ° S a e P( 7 ) + N 2 ’ 

where a e = p^E[(A'—EfAIS^+t^]) 2 ]- On the other hand, 

I(S 2 + U 2> e, Y 2 ) = h{S 2 + U 2>e ) — h(S 2 + U 2i e\Y 2 ) 

1 , a k+ a k, e 

2 ° S d 2 ( 7 )+ ( 7 C 2 , 2e - 


Therefore, 


’s 2 


’u 2 . 


__ Pin) + N 2 

d 2 {j) + a?j 2 c a t P{^) + N 2 


(42) 


Note that 


J(S 1 + U 1 ,c;S 1 (7),5 2 (7)|S2 + C/ 2 ,e) 

= /(Si + U lie> S 2 + E7 2 , £ ; Sr ( 7 ), 5 2 (7)) 
- I(S 2 + U 2t e, Si ( 7 ), 5 2 ( 7 )) 

= /(Si + Ui,e, 5 2 + P 2 ,c; Si( 7 ), 52(7)) 
-I(S 2 + U 2 y,S 2 (j)) 


(43) 


= /(Si + U ll£J S 2 + U 2 , e ; S x (7), S 2 ( 7 )) - I(S 2 + U 2 y, Yi) 
_ 1 , |E Sl ,S 2 + S Ui, e ,E/ 2 J 
"2 ° g |0( 7 ) + S Uli ., C r ai .| 

-^ iog P pT\ + ,^ . (44) 

2 a e P{ 7 ) + Ni 

where (l43l ) is due to ( 14 1 [ 1 . On the other hand, 

J r (S 1 +U 1 , e ;S 1 (7),5 2 (7)|52 + ^ 2 ,e) 

= /l(S 1 +U 1 ,e|52 + CI 2 l e) 

- hi S + U ll£ |5 2 + U 2 ,e, Si( 7 ), 5 2 (7)) 

= hi Si + Ui,c|5 2 + U 2 , e ) - hi S + Ui, £ |S 1 ( 7 )) (45) 

1 1 |SS1,S 2 + ^Ul,e 5 t72,el 

2 ° S |0i(7) + S Ul , e |(o -| 2 +Vu 2t )' 


where 


is due to ( HTV Combining (f4~Gl> and d44l) gives 

|S Sl ,s 2 + S Ulie)t / 2 | 


l®i(7) + s Ui 


’s 2 


u 2 ,, 


) 


_ |S Sl ,s 2 + s Ui,eP 2 ,J(Q(cP(7) + Ni) 

|©(7) + E UliE ,t/ 2 , e |(P(7) + N i) 

which, together with (l40t and (142b . implies that 

|S Sl ,s 2 + £ Um)I 7 2> J 


P( 7 ) = lim Ni 


e^O |0i( 7 ) + E Ule |!d2(7) + ^U 2 .e 

2 1 cr 2 

s 2 + a u 2 „ 


+ (A 2 -iVi) 


Ml) + a U 2 ,, 


-No. 


(47) 


Note that 


Ai(Di - © 1 ( 7 )) = 0 
=> HfAi(Di - ©i(7))Si = 0 
=> HiS( (Di - ©i( 7 ))Si = 0 , 

which further implies that 3( (Di — ©i( 7 )) 3 i is of the form 
diag( 0 rxr ,A), where 0 rxr denotes an r xr all-zero matrix. 
Also note that 3f Eu, € Hi = Ilj ” 7 — 3 f©i( 7 )Si. Therefore, 

|©i(7) + SuJ 
e-s-0 |Di + Eu l e | 

= ©i( 7 )Si + 3f S Ule 5i| 

£^■0 |3fD 1 S 1 + S( Eu lje Hi| 

= _inr^l_ 

™o|n- 7 + 3f(Di-© 1 ( 7 ))3i| 




















= lim 

e-X) 

= 1 . 


in 


di 


g +diag(O rX r, A)| 


(48) 


Now one can readily prove (l35l > by combining ( 1471 and (l48l) . 
This completes the proof of Theorem U for the case d> < 

M°s 2 )- 

By restricting Sui,t / 2 to the form diag(Su 1 ,ct^ 2 ) and 
letting afj 2 —>■ oo, we can obtain the following lower bound 
from Corollary Q] 

P(D l 5 d 2 )> sup iVi ^+^' -iVi. (49) 
Su,^0 |Ui + 2jUi| 


Note that if 7 > cr| 2 , then @( 7 ) = @(<r| 2 ) and <^ 2 ( 7 ) = 
d 2 (cr| 2 ); moreover, in this case we have A 2 = 0 (which implies 
that afj 2 e tends to infinity as e —> 0 ), and consequently 


P( 7 ) = lim jVt |SS " S2 + ^ U r X U2 ’i 
e^o |Di + S Ul J|d 2 (7) + c7^ 2i 


+ (N 2 - N 1 ) 
= lim Ni 


a s 2 


’u 2 . 


di{l) 

Ssj + Su! 


-N 2 


e—*0 


|Di + S Ule 


u 2 , e 

-Ni. 


Therefore, the lower bound in d49l > is tight when d 2 > da (tr| 2 ), 
which completes the proof of Theorem [2] ■ 

It is instructive to note that the role of I(S 2 + U 2 tC ',Y 2 ) 
and /(Si + Ui, e ; 81 ( 7 ), £ 2 (7)|£ 2 + t/ 2 , e ) in the achievability 
argument is similar to that of /(V 2 ; T 2 n ) and 7(V"; yi"|V 2 ) 
in the proof of Corollary Q] One can also readily see that (l39l > 
and d4lT > imply 


lim /(Sx + U M , £2 + U 2 e ; S 1 ( 7 ), 5 2 ( 7 )) 

e->0 

= J(S 1 ,5 2 ;S 1 (7),S 2 (7)), 

/(Sr + U M , £ 2 + C/ 2 , £ |Si(7), £ 2 ( 7 )) = 0, 


respectively. These two equations can be viewed as the coun¬ 
terparts of (l23t and ( 1241 . 

It is implicitly assumed in our construction that £si,S 2 >- 
Di >- 0, and d 2 > 0. In fact. Theorem [2] also holds in the 
degenerate case where the source covariance matrix and the 
distortions are not strictly positive definite, i.e., we can relax 
the condition to Eg, ,s 2 cl 0 (which includes the case where 
S 2 is a linear function of Si), Di A 0, and d 2 > 0. It is 
straightforward to verify that Corollary Q]is directly applicable 
in this setup. For the achievability part, one can leverage 
the construction for the non-degenerate case via a simple 
perturbation argument. The details are left to the interested 
reader. 


B. Alternative Optimal Hybrid Schemes 

It turns out that in the vector-scalar case the hybrid scheme 
that achieves the optimal tradeoff between the transmit power 
and the reconstruction distortion pair is in general not unique. 
Specifically, we shall show that if the optimal solution to ( |3(H ) 


is of the forrr@ ©( 7 ) = diag(©i( 7 ), 6 * 2 ( 7 )), then there exists 
a class of hybrid schemes with the same performance as that 
in Section HV-AI 

Some additional notation needs to be introduced first. Recall 
Si( 7 ), £ 2 ( 7 ), Qi, and Q 2 defined in Section IIV-A1 and 
define A = £ 2 ( 7 ) — E[£ 2 ( 7 )|Si( 7 )]. Now write A = Ao + 
Ai + A 2 , where Ao, Ai, and A 2 are mutually independent 
zero-mean Gaussian random variables with variances to be 
specified. Furthermore, let £ 0 ( 7 ) = E[£ 2 ( 7 )|Si( 7 )] + Ao and 
£ 2 ( 7 ) = £ 0 ( 7 ) + At. Note that (Qi,< 3 2 ) is independent of 
(A 0 , Ai, A 2 ); moreover, since ©( 7 ) = diag(©i( 7 ), 6 * 2 ( 7 )), it 
follows that Qi and Q 2 are mutually independent. Therefore, 
Si -H- Si( 7 ) -H- £ 0 ( 7 ) ++ £ 2 ( 7 ) «->• £2 form a Markov chain. 

Note that 

£0(7) =E[£o(7)|Si,£ 2 ] + Wo 
= af Si + cl 2 S 2 + Wo, 
S 1 (7)=E[S 1 ( 7 )|Si,£o(7)] + Wi 
= BiSi+b 2 £ 0 ( 7 )+Wi J 
£2(7) = E [£2 (7) I £2, £0 (7)] + w 2 
= ci £ 2 + c 2 £ 0(7) + W 2 , 

where Wo is independent of (Si,£ 2 ), Wi is indepen¬ 
dent of (Si, £ 2 , £ 0 ( 7 ), £ 2 ( 7 )), an d W 2 is independent of 
(Si, £ 2 , £ 0 ( 7 ), Si( 7 )). We dehne 

Si( 7 ) = BiSi+W 1 , 

£ 2 ( 7 ) = ci £ 2 + W 2 . 

We are now in a position to describe the scheme (See Fig. 

0 . 

Encoding: Let the channel input X", with average power 
P( 7 ), be a superposition of an analog signal X" and two 
digital signals X£ : and X"; 2 (i.e., X n = X" + X^ + X% 2 ). 
The analog portion is given by X™ = /3(afS" + a 2 £ 2 ) for 
some non-negative number /3 to be specified later. For the 
digital portion X^ 2 , the encoder first uses a Wyner-Ziv code 
of rate R 2 with codewords generated according to £ 2 ( 7 ), with 
£ 2 as the input, and with X™ + X^ l + ZV; as the decoder side 
information; the encoder then determines X % 2 to send the 
bin index of the chosen Wyner-Ziv codeword £ 2 ( 7 ) by using 
a channel code of rate R 2 . For the digital portion X^' 1 , the 
encoder first uses a Wyner-Ziv code of rate i?i with codewords 
generated according to Si( 7 ), with S" as the input, and with 
X" + X'l' .j + Z™ as the decoder side information; the encoder 
then determines X'j 1 to send the bin index of the chosen 
Wyner-Ziv codeword S" ( 7 ) by using a dirty paper code of rate 
i?i with X" treated as the channel state information known at 
the encoder. We dehne P a = E[(X a ) 2 ] and P dl = E[(X'd i ,) 2 ], 
i = 1,2, where X a = j0(afSi + a 2 S 2 ), X dj i, X di2 are 
mutually independent zero-mean Gaussian random variables, 
and P a + P dj 1 + P d}2 = P( 7 ). 


Decoding: Receiver 2 decodes the channel code X'{ , 2 , sub¬ 
tracts it from the channel output Y 2 = X"+X^ 1 +X ^ 2 + Z^', 

4 Note that this condition is satisfied if diag(Di, 7 ) R In this case 

it follows by Fischer’s inequality that 0 ( 7 ) = diag(Di, 7 ). 
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Y " 

Y" 



S r(r) 


Fig. 3. An illustration of the hybrid scheme in Section HV-B I 


and recovers by decoding the Wyner-Ziv code (the 

one of rate R 2 ) with X™ + X ^ 1 + Z% as the side in¬ 
formation. Furthermore, in view of the fact that the linear 
MMSE estimate of S 2 based on ( 62 ( 7 ), X a + X dt i + Z 2 ) 
is 5 2 (7) = PiS^) + p 2 (X a + X dA + Z 2 ), where (pi,p 2 ) is 
an arbitrary solution to the following equation 

/ E[(5 2 ( 7 )) 2 ] E[P 2 ( 7 )X a ] 

[Pl1 P2) ^ E[5 2 ( 7 )X a ] P a + P dA + N 2 

= (E[5 2 S 2 (7)],E[S 2 X 0 ]), 

Receiver 2 can use S 2 (7) = piS 2 (7) + p 2 (X " + X^ ± + Z 2 ) 
as the reconstruction of S %; the resulting distortion is denoted 
by d 2 {p)). Receiver 1 also decodes the channel code X " 2 and 
subtracts it from the channel output Y { 1 = X™+X dl +X d2 + 
Z" . Then Receiver 1 decodes the dirty paper code and recovers 
S” (7) by decoding the Wyner-Ziv code (the one of rate Ii\) 
with X '“ + X 'l | + Z" as the side information. Furthermore, in 
view of the fact that the linear MMSE estimate of Si based 
on (Si (7), X a +X dt i + Zi) is Si (7) = Sr (7) + /3 _ 1 b 2 (X a + 
X d} i+Zi), Receiver 1 can use S"( 7 ) = S”( 7 )+ / 9 _ 1 b 2 (X” + 
X dl + Z") as the reconstruction of S". 

Coding Parameters: Seven parameters E[(Ao) 2 ], E[(Ai) 2 ], 
/3, R{, R 2 , P d .\, and P d . 2 still need to specified. Equivalently, 
we shall specify E[(Ao) 2 ], E[(Ai) 2 ], P a , Ri, R 2 , P(j), and 

Pd 2 - 

We again choose P{ 7 ) such that 

1 p(n/) + JVl 

I{Si, S 2 ; Sx( 7 ), 5 2 ( 7 )) = - log — ——“■ (50) 


determined by the following equation 


i, Pin)-PI 2 + ^1 

Ni 


■log 


= I(Si,S 2 ; Si( 7 )). 


Note that P* t 2 is nonnegative since 

I(S U S 2 ; S!( 7 )) < /(Si, P 2 ; S 1 ( 7 ), S 2 ( 7 )) 

= ilog Ml*. 

2 S iVi 

Now choose E[(Ao) 2 ] such that 

r , c c ci / \ c / \i 1 1 P(l) ~ Pd,2 + Ni 

/(S 1 , 5 2 ;S 1 ( 7 ), 5 0 ( 7 )) = - log-—-• 


(51) 


The existence of such E[(Ao) 2 ] is guaranteed by the 
fact that one can let I(Si,S 2 ;Si( , y),So{'y)) take any 
value in [/(Si, S 2 ; S 1 ( 7 )),/(S 1 ,S 2 ; S 1 ( 7 ),S 2 ( 7 ))] (i.e., 
[|log P(7) ^M log^A]) by varying E[(A 0 ) 2 ]. 
We then choose P a £ [0, P(t) — P d , 2 ] (which further 
determines P d 1 and 3) such that 


I(X a -,X a + X dtl + Z 1 ) = I(S 1 ,Sr,So('y)), (52) 

which is always possible in view of ( |5T1 ) and the fact that 
one can let I(X a ]X a + X d: i + Z 1 ) take any value in 
[0, i log P( 7 ) ~g' 2+JVl ] by varying P a . Next we set 

Ri = /(S i; S 1 ( 7 )|A 0 + X di i + Z\). (53) 


We finally choose E[(Ai) 2 ] such that 

I(S 2 ; 5 2 ( 7 )|A 0 + X dt i + Z 2 ) 
.1 m+Ni 
2 S P«+P,l,l + JVa 

and set 


(54) 


Let P di2 be an arbitrary number in [0 ,P d2 ], where PJ 2 is 


R 2 = I{S 2 ; 5 2 ( 7 )|A a + X d<1 + Z 2 ). 


(55) 
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It is not immediately clear that our particular choice 
of E[(Ai) 2 ] always exists. To stress the dependence of 
I(S 2 ; *§2(7)! X a + X dt i + Z 2 ) on E[(Ai) 2 ], we shall denote 
it by 0(E[(Ai) 2 ]). Note that ( l 52 l ). together with the fact 
that I(X a -X a + X dtl + Z x ) = I(S 1 ,S 2 ;X a + X dA + Z x ), 
implies that I(S 1 ,S 2 ;X a + X d)1 + Z x )_= /(Si, S 2 ; 60(7)); 
moreover, since both X d< i + Z\ and Wo, which are Gaus¬ 
sian random variables, are independent of (Si, 62), it 
follows that the joint distributions of (Si, S 2 , P~ x (X a + 
X d ,i + Z\)) and (Si, S2, ^(t)) are identical, which, in 
view of the fact that W1 and W 2 are independent of 
(Si, S2, £0(7), X a + X d 'i + Zi), further implies that the joint 
distributions of (Si, S 2 ,’p~ l (X a + X dt i + Z{), Si (7), £2(7)) 
and (Si, 5 2 , 50(7), 81(7), ^2(7)) are identical Therefore, 
we have 


V-(E[(Ai) 2 ]) 

= I(X a + X d7 + Z 2 , Sr, S 2 (j)) 

— I(X a + X d i + Z 2 ; S 2 (j)) 

= I (Sr, 5 2 (7)) - / (Xa + X d , 1 + Z 2 ; S 2 (7)) (56) 

> I(Sr S 2 (j)) - I(X a + X d7 + Zi; S 2 ( 7 )) 

= i(srs 2 ( 7 ))-i(s 0 ( 7 y,s 2 ( 7 )) 

= i(SrS 2 ( 7 )\s 0 ( 7 )) 

= i(SrS’ 2 ( 7 )\S 0 ( 7 )), 


where (l56l > is due to the fact that (X a + X d ,i + Z 2 ) f> S 2 <-> 
S 2 ( 7 ) form a Markov chain. Clearly, 0(E[(Ai) 2 ]) is a con¬ 
tinuous function of E[(Ai) 2 ]. When E[(Ai) 2 ] = 0 , we have 
£2(7) = £>0(7) (which implies S 2 ( 7 ) = 0 ) and consequently 
■0(0) = 0 ; when E[(Ai) 2 ] = E[(A) 2 ] — E[(Ao) 2 ], we have 
S'(7) = £>2(7) and consequently 0(E[(A) 2 ] — E[(A 0 ) 2 ]) > 
I(S 2 -, S 2 ( 7 )\S 0 ( 7 )). Note that 



P( 7 ) + 


= /(Si,S 2 ;Si(7),S 2 (7)) 

= /(Si,S 2 ;Si(7),S 2 (7),S 0 ( 7 )) 

= J(Si, S 2 ; Si (7), S 0 ( 7 )) + S 2(l)\Soh)) 

1 , Pa + Pd, 1 + Xl r o ! Wot \\ 
= 2 lo §--+/(S 2 ;S 2 ( 7 )|So( 7 )), 


( 57 ) 


( 58 ) 


where 63 and (l58l > are due to (l50l > and (BTt , respectively. 
This implies 


J(S 2 ; S 2 ( 7 )|S 0 ( 7 )) 


I log _ATAA. 

2 s P„ + Pai + JVi 


Therefore, we have 


0(E[A 2 ] — E[Aq]) > - log 


P(l) + N, 

Pa + Pd,l + N\ 

>fiog p W + iVa . 

- 2 5 P„ + Pt, 1 + N, 


Hence, our choice of E[A 2 ] indeed exists. 


5 We have implicitly assumed that E[f aj S 1 +S2S2) 2 ] > 0 (which implies 
that the P a and the B determined by 1521 are positive). For the degenerate 
case a) Si + S2S2 = 0 (which is possible if and only if So (7) = 0 ), one 
can simply set X a = 0 and (A 1 (X a + X d , \ + ZB) = 0 . 


Conditions for Correct Decoding: Receiver 2 needs to de¬ 
code the channel code and the corresponding Wyner-Ziv code 
of rate R 2 , and the correct decoding of these two components 
are guaranteed by d54l i and d55l) . Since Receiver 1 is stronger 
than Receiver 2 , it can also decode the channel code and 
subtract it from the channel output. Receiver 1 additionally 
needs to decode the dirty paper code and the corresponding 
Wyner-Ziv code of rate R\, the latter of which is guaranteed 
by dH. 

Recall that the joint distributions of (Si, S 2 , f3~ 1 (X a + 
X d ,i + Zx), Si( 7 ), 5 2 ( 7 )) and (Si, S 2 , 5 0 ( 7 ), Si( 7 ), 5 2 ( 7 )) 

are identical. Therefore, we have 


Ri = /(Si;Si( 7 )|A a + X dil + Zi) 

= /(Si;Si( 7 )|5 0 (7)) 

= /(Si,S 2 ;Si(7)|S 0 (7)) 

= /(Si,5 2 ;Si(7),5o(7))-/(Si,5 2 ;S 0 (7)) 

1 , Pa + Pd, 1 + Xi 1 P a + P d ,l + JVi 
= 2 l0S - N, - 2 ° g P d>1 + N, 


1 , Pi, 1 + 
= 2 l0g — 


JVi 


( 59 ) 

( 60 ) 
( 61 ) 


where (l 59 l > follows by the fact that S2 <->■ (£>0(7), Si) •<->• 

51 (7) form a Markov chain (which is implied by the fact that 

5 2 — So(7) 81(7) •H’ Si form a Markov chain), and (l 60 t 

is due to ( 15 I l i and (l 52 l >. Thus indeed Receiver 1 can decode 
the dirty paper code correctly. 


Optimality of this Class of Schemes: Since the joint 
distributions of (Si, £>1(7)) and (Si, 81(7)) are identical 
(which is due to the fact that the joint distributions of 
(Si J~ 1 (X a + X dA + Z 1 ),S 1 ( 7 )) and (Si, S 0 ( 7 ), Si (7)) are 
identical), it follows that the resulting distortion at Receiver 1 
is @1(7), which is the same as that achieved by the optimal 
scheme given in Section ITV-AI We next focus on the distortion 
achieved at Receiver 2 . 

Note that we have the freedom to choose P d , 2 from [ 0 , P d2 \- 
In particular, one can recover the hybrid scheme in Section 
IIY-Al bv setting P d 2 = 0 . We shall showQ that the reconstruc¬ 
tion distortion at Receiver 2 (i.e., d 2 ( 7 )) does not depend on 
P d<2 ; as a consequence, this class of schemes have exactly the 
same performance, and can all achieve the optimal tradeoff 
between the transmit power and the reconstruction distortion 
pair. Note that 

1 |E[(Si — E[Si|S 2 ])(Si -E[Si|S 2 ]) t ]| 

2 ° g |0i( 7 )| 


h(S ± \S 2 ) 

-ft(Si|Si( 7 )) 


fc(Si| S 2 ) 

-/i(Si|5 2 ,5o(7),Si( 7 )) 

( 62 ) 

J(Si;So( 7 ),Si( 7 )|S 2 ) 


I(Si\X a 

+ X d ,i + Zi, Si ( 7 ) |jS , 2 ) 

( 63 ) 

cc 

+ A di i + Zi,Si( 7 )|5 2 ) 


/(Si;A a 

+ X d ,i + Zi|5 2 ) 


+ /(Si; S 

'1 (7) \Xa + X d ,i + Z\) 



6 It is clear that the reconstruction distortion at Receiver 1 (i.e., 01(7)) 
does not depend on P ^ 2 
















11 



P' 


Y* 


Y" 

1 2 



Mr) 


Fig. 4 . A variant of the hybrid scheme in Section HV-B | 


= /( Sv,X a + X dA + Zi |S 2 ) + l log 

Z iv i 

_ 1 E[(X a - E[X 0 |S 2 ]) 2 ] + P dA + N, 

2 ° S P d ,i + ^ 

, 1. P d ,i+JVi 
2 ~Ni 

_ 1 , E[(X a ^E[X a |^ 2 ]) 2 ]+P d!l +jV 1 

2 S iVi 




(64) 


where ( 162 } follows from the fact that Si Si( 7 ) •<->■ 
(S' 2 , 5 'o( 7 )) form a Markov chain, ( 163} follows from the 
fact that the joint distributions of (Si, S 2 , /3~ l (X a + X d \ + 
Zi),Si( 7 )) and (Si, <S' 2 , jS’ 0 ( 7 ), Si( 7 )) are identical, and (164} 
is due to (|6T1 >. Therefore, E[(A 0 — E[|^ 2 ]) 2 ] + P d . 1 is not 
affected by the choice of P d 2 . Since 


t s 2 


A Variant of this Class of Optimal Schemes: For each 
P d> 2 E [0,PJ 2 ], the aforedescribed scheme has the following 
variant (see Fig. H). Now for the digital portion X% 2 , the 
encoder simply uses a lossy source code of rate I(S 2 ; >§2(7)) 
with codewords generated according to S 2 (7) and with S% as 
the input, and sets V f ” 2 to be the output codeword 5 2 ( 7 ) 
multiplied by some non-negative number f3', where S' is 
chosen such that E[(X Q + X d ^ + / 0'5 2 (7)) 2 ] = P( 7 ). 
The remaining part of the encoder is still the same. Define 
Y t =X a + X dA + /?%( 7 ) + Zi,i = 1, 2. Note that 

I(S 2 ; s 2 { 7)) + I(S 2 ; v a + A di i + Z 2 |S 2 ( 7 )) 

= /(^; 5 2 ( 7 ),A a + A d> i + Z 2 ) 


1 CTg 

2 S ^( 7 ) 

= ^(<S , 2; <S2 (7)) X a + Ad,i + Z 2 ) 

= 7(5^; -A a + X di i + Z 2 ) + /(iS 2 ; <S 2 (7)|A a + X^i + Z 2 ) 

1 p(<v) + iVo 

= X a + A d ,i + Z 2 ) + - log 2 (65) 

^ “o + Ti.i + -fV 2 

_ 1 , Pa + Pd,l + iV 2 

“ 2 ° S E[(A a - E[X a |S 2 ]) 2 ] + P d , 1 + V 2 

+ l [og Pl7) + JV, 

2 8 Pa + Pd .,1 + N 2 

1 1 p(7) + N2 rfifil 

2 ° S E[(A a — EfXa)^]) 2 ] + Pd,t + X 2 ’ } 

where ([65} is due to ( [54} . it follows that d 2 { 7 ) does not depend 
on P dj2 . 


1 0 % 

= 2 l0S ^) 

1 , _ Ph) + n 2 

2 ° g E[(A a ^E[A a |5 2 ]) 2 ]+P d ,i 


No 


(67) 


= h{Y 2 )-h(Y 2 \S 2 ,S 2 ( 1 )) 

= 7(5 2 ,5 2 ( 7 );V 2 ) 

= /(5 2 (7);V 2 ) + /(5 2 ;y 2 |S 2 (7)) 

= J(5 2 ( 7 ); V 2 ) + J(5 2 ; A a + X dA + Z 2 \S 2 (j)), 

where (167} is due to (166} . This implies 

I(S 2 ;S 2 ^)) = I(S 2 (^Y 2 ). 

Hence, Receiver 2 can decode the lossy source code and 
recover S 2 ( 7 ). Furthermore, Receiver 2 car@ use ST)( 7 ) as 
the reconstruction of S 2 , and the resulting distortion is d 2 { r f). 
Receiver 1 can also decode the lossy source code and obtain 

7 Note that Receiver 2 can obtain X£ + X? i + ^2 f rom §2 (7) and 
y 2 = X2 + XI j + jS'SJ (7) + Z?. 
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X” + X£ i + based on S%{ 7 ) and = X£ + X^ + 
P'S^i'y) + Z". Then Receiver 1 decodes the dirty paper code 
and recovers S" ( 7 ) by decoding the Wyner-Ziv code (the one 
of rate f?i) with X" + X% ± + 2 T" as the side information. 
Moreover, Receiver 1 can use £>”( 7 ) as the reconstruction 
of S”, and the resulting distortion is © 1 ( 7 ). Therefore, this 
scheme has exactly the same performance as the original one. 
It is worth mentioning that the scheme in flOl can be viewed 
as an extremal case of this scheme with P^ 2 = P£ 2 and 

TOi = 1. 


V. Conclusion 

We have obtained a lower bound on the optimal tradeoff 
between the transmit power and the achievable distortion pair 
for the problem of sending correlated vector Gaussian sources 
over a Gaussian broadcast channel, where each receiver wishes 
to reconstruct its target source under a covariance distortion 
constraint. This lower bound is shown to be achievable by 
a class of hybrid schemes for the vector-scalar case, i.e., the 
scenario where the weak receiver wishes to reconstruct a scalar 
source under the mean squared error distortion constraint. For 
certain classes of sources and distortion matrices, it is possible 
to extend our hybrid schemes to obtain a characterization 
of the optimal power-distortion tradeoff for the case where 
the weak receiver also wishes to reconstruct a vector source. 
However, a complete solution for this general setup remains 
elusive. 


Appendix A 
Proof of LemmaQ] 

Let W(f) and W (t) be the f-th columns of W and W, 
respectively, t = 1, • • ■ , n. Note that 


h{ W|W) 

n 

= MW(i)|w) + £ h(w(t)\w, w(i), • • •, w(t - 1 )) 

t =2 
n 

< 5>(W(i)|W(i)) 
t= 1 
n 

<5>(W(t)-W(i)) 

t= 1 


< Y \ log 27reE[(W(t) - W(f))(W(f) - W (t )) 1 


71 1 

< 2 lo S 


n 1 

= 2 l0g 


^ £E[(W(f) - W(f))(W(f) - W^)) 1 


2 ne 


E[(W — W)(W — W)" 3 


which completes the proof of Lemma Q] 


Appendix B 
Proof of Lemma[ 2 ] 

Let Wi(i) and W 2 (i) be the f-th columns of Wj and W 2 , 
respectively, t = 1, • • • , n. Let L be uniformly distributed over 
{1, • • • ,n} and independent of (Wj, W 2 ). We have 

MWi|W 2 ) 

= M Wi(i)|w 2 ) 

n 

+ Y, /i(W 1 (f)|W 2 , Wifi), • • ■ , Wifi - 1)) 

t —2 

n 

<^MW!(f)|w 2 (f)) 

t=1 

= n/i(Wi(r)|w 2 (r),r) 

<n/i(Wi(r)|W 2 (r)). ( 68 ) 

It is easy to see that 

E[(Wf (T), Wj (r)) T (Wf (F), (T))] 

= ^E[(Wf,W 2 T ) T (Wf,W^)]. 

Let WifT) be the linear MMSE estimate ofWifT) based on 
W 2 (T). Note that 

EffWifr) - w 1 (r))(w 1 (r) - Wifr)) 7 ) 

|E[(Wf (T), Wff (T)) r (Wf (T), Wif (T))] | 
|E[w 2 (r)wJ(r)]| 
|iE[(wf,w!T(wf,wj)]| 

|lE[W 2 Wj]| 

Now continuing from (1681) . 


n/t(Wi(r)|w 2 (r)) 

< nft(Wi(r)-Wi(T)) 

27reE((Wi(r) - Wj(r))(Wi(r) 
^E[(Wf,W^) r (Wf,W^)]| 

2^6 |2£e E [ W2W T]| 


n . 

- 2 ° g 
n , 


Wif:T)) T ) 

( 70 ) 


where (TTot is due to (f69b . This completes the proof of Lemma 

El 


Appendix C 

The Continuity of ©( 7 ) 

If ©(7) is not continuous at 7 = 7* for some 7* > 0, then 
there exists a sequence {©(7fc)} with 7 *. —>■ 7* and ©(7*.) —> 
© , ( 7 *) 7^ ©(7*) as k —> 00. Clearly, ©'(7*) satisfies the 
constraints for the maximization problem (with 7 = 7*) in 
(l30l) . Therefore, we must have log |©'(7*)| < log |©(7*) |. 
Now let ©(7*,) = ©(7*)— diagfO, max( 7 * — 7^, 0)). Note that 
©( 7 k) satisfies the constraints for the maximization problem 
(with 7 = 7*;) in (f30t when 7 k is sufficiently close to 7*. 
Therefore, 

lim sup log 10 ( 7 fc) | < lim log | © ( 7 *) | = log |©'( 7 *)|. 

fe-s-oo fe->oo 
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On the other hand, it is clear that 

lim log |@(7fc)| = log|0(7*)|. 

K—> OO 

Therefore, we must have log|@'( 7 *)| = log| 0 ( 7 *)|, which, 

together with the uniqueness of ©( 7 *), implies ©'( 7 *) = 

©( 7 *). This leads to a contradiction. 
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